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® Model correlation procedure typically takes several 
months to complete for a large modal test 
° SLS timeframe only allows for less than 2 weeks 


@ Best Model Estimate (BME) process developed to 

perform a QUICK model correlation 

¢ Model that most closely represents test data 

1. Prior to test, create thousands of pretest model 
dispersions 

2. Post test, select one dispersion that best matches the test 
data > provides a coarse optimization 

3. Using single iteration of Attune (from ATA Engineering), 
perform optimization to further refine model 


® BME is a QUICK model tuning effort and not a full 
model correlation 
¢ Full model correlation will occur after test but will not finish 
until much later 
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BME Creation = Dispersions 


@ Candidate set is created with dispersions of 
the nominal test configuration model 


¢ 1000’s of dispersions are created ahead of the test 
—Enables the quick turnaround 


® Each of the model dispersions are compared 
against test data to find the dispersion that 
most closely matches test 
* Mode frequencies 
¢ Mode shapes 


® The best match is further refined using 
optimization tool 
° Refined model is BME 


@ Presentation will show two examples of the 
BME method 
¢ TAURUS-T model 
° Ares I-X 


| MAC |, 


average frequency % error 
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Model Dispersions 

¢ Using MAT cards 
—Uncertainty distributions 

* Dispersion-to-test comparison metrics 
—Frequency 
—Mode shapes — MAC vs XOR 

¢ Pareto front 

¢ Using Attune 
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® Uncertainty factors applied to NASTRAN bulk 
data file MAT cards (elastic modulus or 
spring stiffness) 
¢ Perform sensitivity work to select variables 


@ Create dispersions by perturbing nominal j=- 
* MAT cards: uniform distribution of +20% N 


* Create many dispersions of the test model to cover 
the design space 
—Limited by computational resources and time 
¢ Group parameters to reduce number of variables 
®@ Dispersions are compared against two 
objectives 
¢ Frequency error 
—Average absolute relative error between selected test 
modes and analysis modes 
* Mode shape error 
—Norm of XOR/MAC error (accuracy of eigenvectors) 


* Euclidean norm 
¢ Root sum square of the diagonals (used in future) 


| -MAC |, 


test model 
fi —= fi 
Il 


U 
fiest * 100 
U 


G2 = WWW — [MAC]W }l| 


Design Space of Dispersed TAURUS 


@ Untuned Model 
e Dispersions 
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@ Select model dispersions that best 


matches data io pest — fmodel 
¢ For this example, “test data” is a dispersed g1= W; Fest 
model i=1 t 
¢ Selection based on two “objectives” 
—Frequency error 92 = IIWItW} — [MAC]{w}l| 


—Mode shape error 
° Will likely lead to best set of dispersions 
> Pareto Front 


Design Space of Dispersed TAURUS 

Pareto front is a natural outcome of eicteena ew 
multiobjective optimization | © Untied ode 
No solution is THE optimal solution ; —O- Pareto Front 
Set of non-dominated optimal ae: 
solutions 
Pareto BME discrimination factors 
* Closeness to nominal model cal! 
* How models do when different weighting tos} yt 

factors are used I : 
¢ Using different mode shape error norm 


¢ ¢¢ 


1 4 u 1 1 1 J 
10 15 20 25 30 35 40 
average frequency % error 
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BME Selection = Attune 


®@ After selection of the best single dispersion, Attune is used to for further 
model tuning 
* Use same mode shapes and frequencies as was used in the model dispersion process 
¢ Variables and groups will be the same as used in model dispersions 
¢ Upper and lower bounds on variables will be closer to nominal than the dispersion 
uniform distributions 
—Attune rewards these designs in objective function 
¢ Use of cross-orthogonality or MAC built in 


¢ Can weight or de-weight modes as desired 
—Will keep same weights as dispersions 


@ Attune = BS 
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@® Examples 
¢ TAURUS 
° Ares I-X 
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three models of increasing rocket-ness 
¢ ET40 cart model (in back-up charts) 
—EV31 intern, Megan Hathcock, built a finite element model, performed modal 
tests, and correlated the nominal model to the test data i 
—Simple, already have test data, have correlated model 7 
¢ JSC TAURUS-T 
—Correlated model and model description from Rodney Rocha 
—Test data provided by Michael Grygier 
—Simple, test data provided 
—Sent a tuned version of the TAURUS-T back to JSC for use in the transient 
response method 
° Ares I-X 
—Actual launch vehicle with test data 
—Nominal model and optimized model provided by Mercedes Reaves at LaRC 
—Test data provided by Dan Lazor (primary curve fitter for I-X) 


® The BME dispersion process has been implemented on | 
| 
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Example: TAURUS 


® Test Article Unit for Rectified Utility Systems Testing (TAURUS-T) 
¢ Unistrut structure 70” wide and 80” in height 
* Bolted to floor (rough approximation of cantilever) 
¢ Joints modeled with springs since unistrut bar shear centers do not quite align 
¢ Joint stiffness approximated by modeling the brackets that connect the bars 
@ Test modes come from hammer tests 
® Correlated model provided 
@ Nominal model created from correlated model by changing joint springs 
¢ Correlated model falls within the range of uncertainties during dispersion process 
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Example: TAURUS 


@ Comparing to the first 
20 test modes 
@ RSS norm of the mode 


shape error used as Design Space of Dispersed TAURUS 
tie-breaker for Pareto 3000 Dispersions 
front vi Euclidean Norm 
- Dispersion 372 chosen as © Untuned Model 
starting point for Attune 1.35 ° ° Dispersions 
. . Pareto Front 
© Dispersions 13 ‘ Dispersion 372 
outperform hand-tuned © . -/ 2 Hand-tuned Model 
. 372+Attune 
model and the nominal 4.25 lintuneds Aine 


model after one _N 
iteration of Attune @& 
= 


5 10 15 20 25 30 35 40 
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Example: TAURUS 


Design Space of Dispersed TAURUS Design Space of Dispersed TAURUS 
3000 Dispersions 3000 Dispersions 
al Euclidean Norm ; RSS Norm 

@ Untuned Model @ Untuned Model 

1.355 e e Dispersions e Dispersions 

Pareto Front 2.87 Pareto Front 
1.3/ Pe Dispersion 372 Dispersion 372 

; Hand-tuned Model a Hand-tuned Model 


e | @ 372+Attune 


@ 372+Attune 


1.25 5 _ Untuned+Attune _ 2.67 @ Untuned+Attune 
n 
1.2 foe . _w 
°. 2 24+ 
1.15} . = 
1.14 Soe” ~ 22 
1.057 
2 L 
i ; 
K 
0.95 ! 1g <9 ! 
5 40 5 10 15 20 25 30 35 
average frequency % error average frequency % error 


® Optimizer makes the model “worse” by one metric while improving it in 
another metric 


@ Attune using different metrics than when we started 
* Need to be consistent 
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® Ares I-X 
¢ Actual launch vehicle with test data 
¢ Nominal model provided by Mercedes Reaves at LaRC 
¢ Test data provided by Dan Lazor (primary curve fitter for I-X) 


@ Able to compare BME dispersion process to the optimized Ares I-X model 


found in the literature 
—L.G. Horta, M.C. Reaves, R.D. Buehrle, J.D. Templeton, D.R. Lazor, J.L. Gaspar, R.A. Parks, P.A. Bartolotta, “Finite Element 
Model Calibration for Ares I-X Flight Vehicle,” Journal of Experimental Mechanics, Vol. 51, 2011, pp. 1251-1263. 


e Used same variables as Horta, et al. 


® Used first seven test modes in the dispersion comparisons 
¢ Torsion modes and axial modes difficult to match to test data 


® Used XOR instead of MAC 
* Attempting different mode shape metrics 
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@ Used same variables as Horta, et al. 


i LASE Hi Upper Stage Simulator E HiFirst Stage E Bi Aft Skirt Stiffener E 
9.90E+06 Ib/in.? 3.00E+07 Ib/in.? 2.96E+07 |b/in.? 1.05E+07 Ib/in.? 


| 
oc)... oT = 
| Z 


Y 0 Fwd skirt ext and Frustrum E Wi XL and Fwd Skirt E B Aft Skirt Shell E 
3.00E+07 I|b/in.? 3.00E+07 Ib/in.? 1.05E+07 Ib/in.? 


® Young’s modulus of different parts 
of the vehicle 
° 420% uniform distribution 

® Upper stage simulator springs nee ea Ka, K2, «3 
° 100% uniform distribution 1.00€+07 Ib/in. ~ 1.00€+07 Ib/in. 


Upper Stage Simulator Spring 2 Upper Stage Simulator Spring 1 
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Example: Ares I-X Dispersions 


@ Using Euclidean norm, the Pareto front outperforms the nominal model 


and the hand-tuned model 


@ Using Attune, the Pareto designs get “worse” 
@ Using the RSS norm of the XOR shows that the optimized model of Horta, 


et al. is Pareto-optimal and is on par with dispersions + Attune 


@ Seems to be a limit on how well the Ares I-X model can be tuned 


0.248 
0.247 
0.246 
0.245 
~ 0.244 
0.243 
0.242 
0.241 
0.24 
0.239 
0.238 


| -XOR | 


Design Space of Dispersed Ares 1X 
2177 Dispersions 
Euclidean Norm 


@ Untuned Model 
* e Dispersions 


Pareto Front 
Disp 1339/1955 
Hand-tuned Model 


@ 1339/1955+Attune 
@ Nominal+Attune 


1 


9 10 11 a2 13 14 
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average frequency % error 
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Design Space of Dispersed Ares 1X 
2177 Dispersions 
RSS Norm 
@ = Untuned Model 


e Dispersions 
Pareto Front 


Disp 1339/1955 
O Hand-tuned Model 
@ 1339/1955+Attune 
@ Nominal+Attune 


10 11 12 13 14 
average frequency % error 
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® Since we only target a few modes to select the BME, what is the effect on 
the non-target modes that may have an effect on the loads analysis 


@ During BME process, only first 7 test modes are kept for the Ares I-X 


comparisons, so we compare test modes 8-14 
° 5 of 7 modes improve in frequency error, only marginally worse for other two 
° 4 of 7 improve XOR diagonal, worst case is decrease from 0.80 to 0.74 (test mode 13) 


®@ Need to check for other models, but maybe rising tide raises all boats 
¢ Improve the physics for some modes, improve the physics for all modes? 


Disp 1339 +Attune 
Model Modes 


1.87} 3.34) 3.70] 3.61| 4.81] 4.86] 3.51] 6.26] 6. 


Freq 


% diff freq 


ray 


0.18 
0.22 
1.06 
1.19 
1.84 
2.06 
3.45 
3.64 
3.67 


4.61 Mocs loca | cos | ooo | om [0103 ft 
4.78 POT cs | oo | coe) om | oor 1003 ORI 
6.18 oo | ons WME coe Meee ooo | ons |0.0310,20/ 0.01 


6.41] 13 | oe | oc | om | oo» | oo | om | ow [0.10] 0.08 | 0.02] 0.01/0.08 [0:80] 0.20] 
6.66 os [on | om J ow | oz | oss | oo [0.03]0.02|0.00]0.22[0.08]0.11]0.27] 


Test Modes 


Test Modes 
WlOIN(DIOmIBR/WIN 


0.06] 0.12] 0.02] 0.07] 0.34] 0 
0.11] 0.04] 0.02] 0.01] 0. 
0.03] 0.01] 0.00] 0.25] 0.08] 0. 
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@ Conclusions/Future Work 
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Conclusions and Future Work 


@ Using model dispersions as a starting point allows us to quickly adjust a 
model to reflect new test data 
¢ The analyst does a lot of work before the test to save time post-test 
¢ Creating 1000s of model dispersions to provide “coarse tuning,” then use Attune to 
provide the “fine tuning” 


@ Successful model tuning on three structures 
¢ TAURUS 
° Ares I-X 
¢ Cart (in backup charts) 


® Mode weighting factors, matrix norm method, and XOR vs. MAC all play 
key roles in determining the BME 


@ The BME process will be used on future tests 
¢ ISPE modal test (ongoing work) 
¢ SLS modal test (mid 2018) 
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BACK UP 


Model Dispersions = Overview 


® Uncertainty factors applied to bulk data file M* cards (Young’s modulus or 
spring stiffness) 
* Piggyback off of prior sensitivity work to select variables 


Xe 


® Create dispersions by applying uncertainty factors 
¢ M* cards have uniform distribution of +20% of nominal values 
¢ Groups of parameters used to reduce number of variables 
* Create many dispersions for the test 
—Goal is 5000 dispersions for each structure 
—Limited by computational resources and time 


® Future Work 


¢ Optimal Latin Hypercube design of experiments used to generate the dispersion designs 
— FAC Viana, SURROGATES Toolbox User's Guide, Gainesville, FL, USA, version 3.0 ed., 2011, available athttps://sites.google.com/site/srgtstoolbox/. 
— Jin, R., Chen, W., and Sudjianto, A., “An efficient algorithm for constructing optimal design of computer experiments,” Journal of Statistical Planning and 
Inference, Vol. 134, 2005, pp. 268-287. 
— Bates, S. J., Sienz, J., and Toropov, V. V., “Formulation of the optimal Latin hypercube design of experiments using a permutation genetic algorithm,” 45th 
AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics and Materials Conference, AIAA, Palm Springs, CA, USA, Apr 2004, pp. AIAA—2004—2011. 
¢ Investigating how to augment the LHS design space if we get extra time or 
computational power 
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SA Intertank LH2 Tank 

2 es ee” ees et 4 on 2 | = EE 250 eal 
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0.820 0.901 
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Frequency error calculation 


Frequency error determined from mode shape matching 


MAC = 


($2 dm)* 


XOR = $: Maadm 


Mode shape error calculation 


Calculation of an initial MAC or XOR comparison 


Note: Guyan mass matrix pulled out of model using Attune DMAP 
MAC matrices are sorted to keep highest values on diagonal 
Use in-house codes sortMAC.m and sortXOR.m 


Details in back-up charts 
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MAC Original Cart Model 


14.6 


WW Loye (=) mY Lore (=15 


16.1 22.6 25.5 265 42 46.7 53.3 


5 


4 
0 
0 
0 


0 
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Test Modes 


N (w 
i=1 


eae = price! 
i 


U 


| eae 
t 


* 100) 


MAC Original Cart Model Sorted 
Model Modes 


26.5 16.1 


42 


14.6 22.6 25.5 53.3 46.7 


MAC/XOR Sort 


@ MAC= 
@ MAC matrices are sorted to keep the highest values along the diagonal 


MAC Original Model Sorted 


MAC Original Model 
Model Modes 


WY FoXe l=) Yi Lexel=13 


14.6 16.1 22.6 255 265 42 46.7 26.5 161 42 146 226 25.5 53.3 46.7 


Test Modes 


7) 
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MAC/XOR Sort Details 


Ma rene ee @ sortMAC.m identifies the 

1aximum value i(_ ) in each 
column, returns the row position, 
and creates a duplicate MAC 
matrix. 


@ lt then compares row positions 
and look for repeats (_). In this 
Row case both 3 and 6 have duplicates. 


Positi . 
sition @ It compares the duplicate values 
Sule and zeroes (__) out the smaller 
one ir the duplicate MAC matrix. 


@ The function then finds the max in 
each column again and repeats 
the process until there are no 
duplicates in the max position 
arrany(_). 


Test Modes 


Test Modes 


Row 
Position 


wu |Ol/ololElololol/o 
0 lololo|olololjo|jo™®& 
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MAC/XOR Sort Details 


@ Once there are no duplicates, the 
function creates a sorting array by 
concatenating the model mode 
numbers anu max position arrays ( 


). 
MAC Original Model Sorted : . 
Model Modes @ The function then sorts the sorting 


85 | IR) 2h | We) MB | oss | eae | aay array by max position and then 

A |e | ee) a ey arranges the original MAC matrix 
and model frequencies by the 
Model Modes matrix. 


7) 
Vv 
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@ Second example for BME process is small cart in ET40 
¢ Initially chosen as a way to test out EV31 operational modal analysis codes 
¢ Model developed and correlated in-house 


¢ Hand-tuning process took 300+ iterations to get final model 
¢ Dispersions + Attune process saves time and effort while achieving similar results 
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BME Example: ET40 Cari Modes 


First nominal model mode (7.5 Hz) is wheel rotation mode and not 
captured in test due to lack of sensors 

Similarly, second model mode (9.1 Hz) is wheel mode 

Modes 3-10 used to compare dispersions to test data 

Data from roving accelerometer test with cart in “grounded” configuration 
¢ Wheels are constrained to prevent motion during testing (duct tape and bolts) 


eee 


eeal Nominal Model Hand-Tuned Test Modes 
Mode # Modes (Hz Model Modes (Hz Hz 
| — | 
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Cart Physical Properties 
Property 


Int. Value Units 


Dispersed + 30% 
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Top Beam Thickness 0.103 in. 
Leg Thickness 0.2 in. 
Shelve Thickness 0.12 in. 
Handle Diameter 0.68 in. 
(OD/ID) 0.61 in. 
Wheel Plate Thickness 0.34 in. 
Edge Thickness in. 
Corner Thickness i 


Cart Material Properties 


Group Property Int. Value 


Units 


29 
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Cart Physical Properties 


Property Int. Value Units 
Top Beam Thickness in. 
Leg Thickness 0.2 in. 
Shelve Thickness 0.12 in. 
Handle Diameter 0.68 in. 
(OD/ID) 0.61 in. 
Wheel Plate Thickness 0.34 in. 
Edge Thickness 0.12 in. 
Corner Thickness 0.16 in. 


Dispersed + 30% 


Top Bar Springs 


K1 1.00E+02 Ib/in. 
K2 1.00E+02 Ib/in. 
K3 1.00E+02 lb/in. 
K4 1.00E+02 | Ib-in/rad 
K5 1.00E+02 | |b-in/rad 
1.00E+02 | Ib-in/rad 


Dispersed + 100% 


Front Wheel Springs 


K1 | 1,006+03 | _Ib/in. 
K1 1.00E+03 Ib/in. K2 1.00E+03 Ib/in. 
K2 1.00E+03 Ib/in. K3 1.00E+03 Ib/in. 
K3 1.00E+03 Ib/in. K4 1.00E+03 | Ib-in/rad 
K4 1.00E+04 | lb-in/rad KS 1.00E+03 | Ib-in/rad 
KS 1.00E+04 | lb-in/rad K6 1.00E+03 | Ib-in/rad 
K6 1.00E+04 | |b-in/rad 


Dispersed + 100% 


Dispersed + 100% 
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BME Example: ET40 Cart Dispersions 


® Starting Pareto points chosen by engineering judgment 
* Chose points with good MAC to avoid mode swapping 


® Hand-tuned model performs the best 

®@ Pareto points + 1 iteration of Attune (magenta) perform nearly as well as 
the hand tuned model while saving time 

@ Nominal model with three iterations of Attune is dominated by the 


Pareto+1 Attune points Design Space of Dispersed CART 
5000 Dispersions 
Euclidean Norm 


=k 


_a 0.8 
O 
=< 
= 0.6 
@ Untuned Model 
0.4 - e Dispersions 
Pareto Front 
bes 3408/2669 
0.2 Hand-tuned Model 
oO @ 3408/2669+Attune 
@ Nominal+Attune 


‘s LS 5 10 15 20 25 30 35 40 45 
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Example: TAURUS 


® The range of joint spring stiffnesses chosen such that the correlated 
model is a possible dispersion model 

®@ 3000 dispersions were created by applying an uncertainty factor between 
0.05-20 for each of the spring degrees of freedom 

@ Young’s modulus and density uncertainty factors between 0.95-1.05 


Nominal min max 
k1-k3 1.0e5 3.3e4 1.8e6 
k4-k5 1.0e5 2.4e4 9.3e5 


Mac: Test vs Hand Tuned Model 


Model Modes 

Freq(Hz)| 3.36 5.02 5.65 27.85 | 27.06 | 30.88 | 38.46 | 438.82 | 47.14 | 49.92 

Freq(Hz)| Mode 4 10 

a 4.92 1 0.00 0.00 

© 6.60 2 0.00 0.00 

2 7.58 3 0.00 0.00 

w | 28.99 4 0.32 0.00 

2 29.37 5 0.75 0.00 

31.40 6 0.06 0.01 

34.76 7 0.00 0.00 

41.10 8 : : : ; 0.00 f _ 0.90 0.02 

43.81 9 0.00 0.00 0.00 0.00 0.01 0.00 0.00 0.00 0.55 0.00 
49.60 10 
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Example: Ares I-X XOR vs MAC 


®@ Using MAC instead of cross-orthogonality will change the Pareto front 
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